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OPTIMUM SUBMARINE ROUTING 



Introduction and Summary 

The purpose of this paper is to develop numerical rou- 
tines to determine a route for a submarine such that the prob- 
ability of its being detected is minimized. The basic theory 
is developed and a numerical routine is available for some of 
the simpler problems. 

A typical problem is the following. The submarine is at 
a point Xo,yo> which we may 1 take to be the longitude and lati- 
tude, and it wishes to go 1 to another point x,p,y^, to be there 
at a specified time T. The probability of being detected in 
a time interval of length At is f(x,y,u,v,w,t)At, assuming 
that it has not been detected previously, u is the bearing 
angle of the submarine, v is its speed, w is its depth, 
and t is the time; f is a function describing the capa- 
bilities of* the hostile observing devices. The submarine wishes 
to take a route such that the probability of being detected en 
route is minimized. 

The problem is an extension of earlier work on ship routing. 
This problem is more difficult than those considered earlier in 
several ways. First, it has more variables. The computational 
time increases roughly as the square of the order of the system, 
and the numerical routines are less stable as the number of 
variables increases. Second, the problem has a control variable 
which is bounded. The depth is bounded by the maximum depth 



which the submarine can stand or can go at any position, whether 
it Is because of pressure or the danger of running aground. It 
is also bounded by zero, at the surface, but the likelihood of 
detection usually increases there and automatically eliminates 
any difficulty. Third, most of the data is empirical and must 
be fitted so as to have continuous second derivatives with re- 
spect to the variables u,v,w. Indeed the collection and fitting 
of the data looks like the biggest single remaining difficulty. 
Fourth, the curves may have corners; that is, there may be points 
where the submarine may need to change its heading, depth, or 
speed by a finite amount. 

The decision was made to use the method of variation of ex- 
tremals used in earlier ship-routing problems. It has the advan- 
tage of flexibility over the method of steepest ascent or gra- 
dients, which is ill adapted to problems wherein the controls are 
discontinuous or bounded. It was originally planned to make the 
routine very general so that it would handle all problems that 
were likely to occur. It is not clear now that this is feasible. 

The problem is simplified if the coordinate set is chosen 
so that the path lies near some great circle, say the great 
circle connecting the initial and final points. Change coordi- 
nates so that this circle becomes the equator. Spherical 
, coordinates, such as longitude and latitude, have a singularity 
at the poles, where longitude is undefined. If the route does 
not vify from this great circle by more than about 400 miles, 
for a route of about 6,000 miles:, maximum, the flat-earth 
assumption is satisfactory and simplifies the computations. 

This depends on the fact that cos 0 is very near one whenever 



2 



|g| < .1 radian. 

The theory for this problem is not readily available, if 
available at all, and it was necessary to include a discussion 
of the cases where the control lies on the boundary of the 
region of allowed values and where corners occur. A separate 
report is being written to give the underlying mathematics. 

Other problems of a new type were encountered and studied. 

If the listening device is accurately located and if the water 
conditions are know- accurately also, it may be possible to deter- 
mine blind (deaf?) areas, regions wherein the submarine is not 
likely to be detected, though the probability of detection is 
large at neighboring or surrounding areas. The boundaries to 
these regions may be sharply defined and the corresponding 
probability generating function f is then discontinuous in . 
the position variables. Some time was spent in trying to develop 
the theory for this, with limited success; with this exception, 
the mathematical theory is reasonably complete. 
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1. Statement of a Typical Problem 

Let us consider for the present the following problem. The 
submarine is to go from one given point x Q ,y 0 to another given 
point x,p,y,p by a given time T. The detecting or listening 
devices have capabilities which are known approximately; we have 
some knowledge of their distribution and we have made measure- 
ments with similar devices to obtain estimates of their perfor- 
mance. We have some data on the weather and have estimated the 
water characteristics. These, together with studies which we have 
made on similar submarines give us the conditional probability of 
detection. If the submarine has not been detected previously, the 
probability of detection in a time 6t is approximately 
f (x,y,u,v,w,t)At , and hence the probability p of being detected 
along the route satisfies the equation t. 
dp = (l-p)f dt. v 

The function f is the best estimate of the detection capabill* 
ties of the hostile observers, as made up by engineers and intel- 
ligence, fitted by mathematicians and programmers. For the present 
no distinction is made here between detection and classif lclatlon. 

The above equation is simplified in form if we let 

(1.1) z = - ln(l-p) ; 
it becomes 

(1.2) z = f. 

We are Interested in long routes and it is assumed that the 
time required to change depth or speed is small compared to the 
total time and may be Ignored. 
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2. Equations of Motion 

Let us take the great circle containing the beginning and end 

points. We shall treat this like the equator , measuring longitude 

x In radians along It and the latitude y In radians normal to 

It. The third coordinate, the depth, will be denoted by w. The 

equations governing the system may be written then 

• v~cos u 
R cos y 

(2.1) y = v_§|2-U 

z = f (x,y,u,v,w,t) , 

where R Is the radius of the earth. The variables x, y,z are 
called the dependent or the state variables; u,v,w are called 
control variables. 

The general problem Is that of determining the control 
variables as functions of time to effect the desired optimization. 
That Is, we want to pick the heading, the speed, and the depth so 
that the submarine will get from the specified Initial point Pq 
to the specified terminal point Prp with z(T) a minimum. The 
probability of being detected along the route Is, by (1.1) 

p(T) = 1 - exp[-z (T) ] , 

and we want to choose the route to minimize this. 
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3*rYal5iafcional Bquations, Adjoint Variables, 



Let us consider any route and a neighboring routed We 
will generate the neighboring route by replacing u,v,w on 
the original route by u+lu,v+ Sv ,w+ W, and this will generate 
variations (first-order changes) in x,y,z satisfying the 
differential equations 



(3.1) 




v cos u sin v - v sin u * cos u 
H cos 2 y <!y ' R cos y R cos y Jv 

^ cos u «5u + ^ sin u Sv 



Sz - f x Sx + f y jy 



+ f u 5u + f v Sv + V w * 
subscripts indicate partial derivatives, f = bf/dx, etc. 

A 

Let us introduce three Lagrange multipliers, p,q,r which 
are unspecified functions of t so far. We multiply each of 
equations (3.1) by one of these, add and integrate from 0 
to T. We may write the result as 
r T 
-0 



(3.2) 



[p(<£x - — ^Vos^y 11 ' y ** y) + q $y + T ^' z - f x^ X 



■t 



U v sin u . v u . « \ 

-Pr cos y + q » + **f„) 3 * 



V COS 13 

R 



U' 



+< pR £ ffr7 ^' q ^ + r V + * V^ dt - 



The terms containing the variations' ofi the dependent variables 
are on the left; those containing the variations of the control 
variables are on the right. 

Now, on the left, let us integrate by parts those terms which 
involve the derivatives of the dependent variables, so as to 
eliminate their derivatives from the integral. We get^ for 
the left side, 
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(3.3) Cpbx + q&y + r6z] - f [6x(p + rf ) + 6y(q + p V 008 + 

0 JO * R cos^y 

+ rf ) + 6zf] dt. 

Jr 

Now, to simplify this, let us ohoose p,q,r as solutions to the 
differential equations 



(V + rf = 0 



( 3 . 4 ) 



v co s . u . s l n jc + rf = o 

u j ^ 

* 0 . 



q + p 2 

R cos y 



Equations (3.4) are called the adjoint of the varlatlonal/equa- 

tlons (3.1). When Eqs. (3*3) and (3.4 are used, (3.2) reduces to 

\ 

(3.5) Cp5x + q6y + r6z]* = f T [(-p g-fif-g + q — - g a - “ + rf u )6u + 

- «p rffry ♦ * ^ + rt r )b7 * 

This is the Important formula that gives us a relation between 
the end values of 6x,6y,6z and an Integral Involving the varia- 
tions of the control variables 6u,6v,6w. It is Important that we 
do not have to bother with the interim values of £>x*6y»&z. 

It is often convenient to consider the above equations as 
vectorial. Let X = xi + yj + zk, P = pi + qj + rk, and ✓ 

( 3 . 6 ) 

Eq. (3*5) then becomes 

( 3 . 7 ) 



p = I co s . j . V-P.l n ,u . . 

* R cos y 1 + R J + fk. 



[P*6X]J = f P»(P u 6u + P v 6v + P w 6w)dt. 



Comments: In the above derivation, we have assumed that there 

are no corners. A corner is a point t^ where any of the oontrol 
variables are discontinuous. If there is a corner at t^, and if 
we allow t^ to vary, then a term must be added on the right 

(3.8) -[P.F]/' dt.; 

t l“ L 
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there is one such term for each corner 



It is also assumed that f has continuous derivatives 
for the moment. This is not the case in some cases of interest, 
but iteseems simpler to discuss this extension afterward. 

Index notation. We will use the vector notation given 
earlier whenever vector properties are to be stressed. It is 
also convenient to use index notation, as follows. Let x,y,z 
be denoted by x£,x 2 ,x 3 , or x*, p,q,r by Pi,P 2 »Ps» or P^» 

R " cos " y * V " S R n ' ' U > f b ? fV»r 2 ,f 3 , or f 1 , and u,v,w by 

Am* 

u 1 ,u 2 ,u 3 or u . The use of superscripts, rather than subscripts 
is common, particularly in differential geometry. In general, 
the state variables and the Lagrange mutlipliers will have Latin 
indices and the control variables will have Greek. 

We will indicate partial derivatives by indices 



(3.9) 



fj = efVex* 1 , f^= s'fVau 7 , 



etc. In this index notation, equations (2.1), (3.1), (3.4), 
(3.5) may be rewritten 



(3.10) 

(3.11) 

(3.12) 

(3.13) 



i 1 = f 1 



Jx 1 = Zfjjx** + If^U^ 

Pi = - xf^p 3 

UPiSx 1 ^ = dt 



. It is understood that the range of both Latin and Greek indices 
will be 1,2,3, and if no confusion seems likely, the inddx of 
summation will not be written. This notation simplifies the 
writing of equations, but no notation eliminates the actual d etails 

of substuting the actual expressions into the various equations, 

* 

carrying out the differentiation, etc. 
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Particular solutions to the adjoint. We may pick partic- 
ular solutions to t;he adjoint so that we get the effects on 
various state variables of changing the control variable; > 

G. A. Bliss did essentially this in Ballistics at Aberdeen 
Proving Ground during World War I. If we pick a particular 
solution P 1 to the adjoint with the propfer.tynthatt P 1 (T) = i, 
then equation (3.5) reduces to 

r T 

(3.14) & x(T) = (P^Sxjp + I ZP 1 *F o .Ju <r dt; 



that is, this particular solution gives us the first-order 
effect on x(T) of changing the control variables. Similarly, 
if the components of P 1 are such that 



(3.15) 



pj (T > ■ % =| 1 

• 0 



.if i = j 

if i * J, 



then 

/*T 

(3.16) £x*(T) = tP L '? (f Sxf r dt + (P i .^X) 0 . 

Note that the subscript on the p*s indicates the component 

4 

and the superscript indicates which state variable it is asso- 
ciated with. 

Finally, if we have a function g(x,y,z) T , to be evaluated 

at the endpoint of the route, we can find its variation as 

„ ’follows. Let us pick a particular solution p\ to the adjoint 

© 

such that at time T, 



(3.17) (P g ) t=5 - Vg , 



gradient g being evaluated at the endpoint of the route. 
For, then, 

(3.18) Sg = X^t Sx* 

&x J 
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.5 Fa 



* (P g *SX) T (by choice of P g ft 

f T 

= (P g .SX) 0 + I xPg.iF^Su 0 ' dt (by (3.7))/ 

We will usually have problems wherein the initial point Xq is 
given ao that Xq = 0 and the first term in the last ex- 

\ 

pression will drop out. On the other hand, we will consider some 
problems where the terminal time T is not specified. In this 
case another term must be added; we will take this up when 
the time arises. 

1 1 
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4; Condition for an Extremum 

In this section the first necessary conditions for an ex- 
tremum will be given; they will be established later* 

We require of any route, to be admissible, that x(0) = 0, 
y (0) = 0, x(T) = x T , y(T) = y T , and we take z(0) = 0. The dif- 



ferential equations 

v cos u 



(2.1) 



x = 



y = 

= f 



R. cos y 
v ~sln u 
R 



must be satisfied. In addition, the depth w must satisfy the 
condition 



(411) 0 S w g ,W aax 

where W Is the maximum depth the submarine can run. In 
max 

addition, the speed v is also limited, 

(4.2) 

with V a constant of the submarine, or perhaps, a function of 

max 

the depth. We are assuming that the additional noise generated 
whenever v = rules out v = V_ ov , but there may be problems 

where the optimum solution will require that v = V max » sdbthat it 
should go at maximum speed, the reduced time more than offsetting 
the increase in noise. 

A route which satisfies the constraints above will be cal- 
led admissible . A set of control variables which are piecewise 
continuous and which satisfy the constraints (4,1) and (4.2) 
are called allowable . Allowability is a local constraint or con- 
dition on the control variable. 



ll 



2 Pa 



j 

. / 



We seek, among all admissible routes, the one suoh that 
z(T) = minimum. Usually there is Just one such route. 

Minimum Principle, Euler Equations. It is a very general 
principle that the optimum route must satisfy the condition 
that the control variables must be chosen so that they maximize 
(4.3) H = P-P 

compared with all allowable controls, for all t, 0 < t < T, 
for some solution P to the adjoint. (This, with a change 
of sign, is the Pontryagin maximum principle.) H is called 
the Hamiltonian. The difficulty is that in P are three 
constants of integration associated with the adjoint. We may 
write 



the P's being defined earlier (see (3*1$) )• 

We can choose one relation among the c's; the most 



other two must be chosen so that x(T),y(T) assumed the 
desired values x T ,y T . 

If the values of u,v,w which minimize H lie interior 
to the domain of allowed values, then the Euler equations are 
a necessary condition 

(4.5) aH/eu^ = o = p*ap/du cr 

or, explicitly. 



(4.4) P = c^ 1 + c 2 P 2 + c 3 P 3 



convenient is to choose c^ to be 1 (one). Then the 




w 



0 



12 



12 1 12 1 
where p * e^p + c 2 P + p , q * o^q + c 2 q + q-', r » 

1 2 3 

c^r + o 2 r + r J , 

The Euler equations and the adjoint system together 
are here called the Euler-Lagrange equations. 

It may be that H Is minimized, not by an Interior 
value of w but by w on the boundary of the allowed values, 

(4.7) »_= W max 

for part or all of the route. This is probably the case 
whenever the search effort Is mostly surfaoe and aerial. 

In this case, the last of equations (4.6) Is replaced by (4.7) ♦ 



5. The Numerical Routine 



. ^ 

In this section the routine for determining the route 

Is discussed. 

Let us guess a set of values for c^,c 2 • (This Aholce 
may pose a little problem but has not In any problems run 
so far). Let us run. the route, determining the control 
variables for each value of t by the minimum principle. 

Let us now consider the effect on the control variables 
of changing c^,c 2 by a small amount. What change would 
this effect In the control variables, assumin^we are at 
any point of the route? The Euler equations (4.5) must 
hold on the original and the varied path, and hence 



<5.D r -2^ a 0l - o 



1 = 1.2. since 



A 0u dq 1 A * du^du” 

The first of these, o' = 1 , Is', when expanded, 



(5.2) 



(-P 



l v 61 ni u 
R cos y 



. _1 v cos u . _1 ^ x _ 

+ 4 g + r f u ) d ?1 



R cos y 
v cos u 



/ _ y uua M 

+ '” p R cos y “ ^ 
/ _ sin u „ 
+ '” p R cos y + ^ 

+ r f uw 6w = 0; 





R 




,2 


v cos 


u 


L 


R 




V 


sin u 






R 


+ 


cos u 


r 



IT 



uu 



uv J 



the second is f cr= 2, 
(5.3) 



/ _1 cos u . _1 sin u . „lx. x^.i 
( p R“coS""y + q R + r f v )dc l 



. , _Z cos u . Jl sin u . JZ + 

+ ( P R^ cos 7 + q R + r f v )d0 2 



+ (-P 



sin u 



cos u 



+ r f, rtl )6u 



R co 8 y + q R ’ * ' vu' 
+ rf^ y 6v + rf vw 6w = 0 ; 



vw 



c 3 = l 



and , for o' - 3 , 

(5.4) f wu 6u + f WT 6y + f ww 6w = 0. 
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Comment i do^ le an ordinary differential, but 6u ie a 
function of t. If f Is independent of u, several of the 
terms drop out. In any case, if the determinant 



(5*5) det(P*P ffX .) 

is not zero, then we get 6u,6v,6w in terms of dc^»dc 2 
in equations of the form 



6u = S 11 dc 1 + S 12 dc 2 
6v = S 21 dc 1 + S 22 dc 2 
6w = S^ 1 dc 1 + S^ 2 do 2 

where Si^ is a function of t. (If the determinant vanishes 
the strong Legendre condition is not satisfied and the routine 
may break down.) When these are put into equation (3*1*0 for 
tfx(T) , we get 



T 



(5*6) 6x(T) = 



s 11 + f s 21 



T 



*1 ./dF c!2 . 3R „22 
r K du b + flv b 



«' 2T I P^F s 01 dt do, 
cr,l(, ^ 1 

—1 —2 

with a similar expression, P — r> P for 



the form 

( 5 * 7 ) 



dx 1 (T) = Z a 1J dc. 

1 J 



+ If s31 )it d 0l 

♦ If S 32 )dt do 2 



6y(T). These have 



Let us calculate, along with the course, a fundamental set of 
solutions to the adjoint. We also solve equations (5*2)/5*3)» 
(5«*0 and substitute the result into (5.6) and its mate for 
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)■ 



'iff- 



f'% 



• v.v 



6y(T) , to generate the integrals for a 1 ^ In (5*7)* Sinoe 









,u 



:* V;;. '»y< 



a**' is dx 1 (T)/flc 1 , we have the mathematical mechanism for 
a Newton-Haphson iteration. That is, to solve, we replace 



dx* by xi - x*(T) , the desired minus the calculated value. 



and generate corrections for 

(5.8) ^ 



x T - x(T) = a 11 Ac 1 + a 



<vv 

12 



•.aV'- 









AG. 



• y T “ y(T) = a 21 ACj + 



22 

a Ac, 



This gives a new estimate of c^.Cg. 



;*>:• •? 

' . <• - ■* »' 

■ '•> •/' f : ' 
/.< ■!' : V- 

&V f -■ 






The principal problem, as usual with a Newton-Haphson 
iteration is that of convergence. We may often force this 









as follows. Kee track of the error 



.1 



,.r 



(5.9) E = [x T - x(T)] 2 + [y T -y(T)] 2 

If this does not diminish on successive iterations, divide 

. i ^ 

the corrections obtained from (5.8) by, say, a factor of 
five. The Newton-Haphson iteration always moves the solution 
in the right direction to improve the solution, but it may 
overshoot badly. Once the values get close to the solution 
they tend to converge rapidly. 












*• kf t ) 

' ? . 
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6. Control Variable on the Boundary, Corners. 

In the above, It was generally assumed that the minimum 
value of H was attained for an Interior value of w, neither 
the maximum nor minimum value. If the minimum value of H 



•v 



occurs for w = W max , then equation (5»^) must be replaced by 






( 6 . 1 ) 



6W as 0 



This may hold only In a certain Intervals, or It may occur 
for the entire route; the variations are given by (5. 2), (513) 
and ( 6 . 1 ) so long as w Is on the boundary. So long as the 
varlables"are continuous, there Is no particular problem; an.- 
extra test must be put In to determine whether the maximum Is 
on the boundary, and when to leave It, etc. 

However, It may be that In some cases the minimizing 
value of u,v,w Is discontinuous. For example, If the 
listening devices are primarily on the surface Initially, 
and In the later part of the route are deep, the submarine 



.,v 






V> ' 
. % ‘S' 



may well need to change from W max to some lower value (a 



shallower route). A oorner can also occur under other clr- 



• 






^urastances. The first condition for a corner Is that there Is 






a point' t^ of the route where two values of the control, , 

say, u'.v'.w 1 and u",v",w" both minimize the Hamiltonian 

'* J 

H. That Is, at this point t.^ of the route 






( 6 . 2 ) 



H(X,U1 ,P,t) = H(X,U",P,t) j* mini 

•U 



( t — t-^ ) 



Further, on the route, 

H(X,U',P,t) > H(X,U",P,t) for t < t. 



( 6 . 3 ) 



H(X,U' ,P,t) < H(X,U",P,t) for tj< t 
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in some neighborhood of t^. If we try to solve for the 
variables by the minimum principle, we will get at least 
three sets of solutions, since there is usually a saddle 
point or a maximum associated with two relative minima of 
a continuous function. 

This brings up the following difficulty. There els no 
general search procedure for finding the minimum of a func- 
tion of several variables. It seems imperative that whoever 
programs the problem must have some feel for the likelihood 
of a corner, and have an idea where to look for the other 
minimum. A routine relying on gross computation will surely 
require excessive computation. 

However , let us assume that we have a corner and we have 
looated the two values U' , U" for the control which yield 
equal values, in (6.2). Let us consider how a change in c^, 
c 2 will change the Hamiltonian H. The change will be due 
to three terras. First, at a given point, H changes dlreotly 
with q^,c 2 . Second changing c^-,c 2 will change U, in ac- 
cordance with (5.2) , ( 5 • 3 ) ,(5.4) , or if w = W mQV ., (5.4) is 
replaced by (6.1). Finally, if t^ is changed, there is 
a term 4~dt. . On an. extremal, ^ + Z + Z 4^ p. 

dt i dt at dx i % fj^i 

QU • Q- ft|J 

+ r — u = when the original equations, and the Euler- 
<r du^ ot 



Lagrange equations are used. Hence dH(X,U‘ s ,P,t) can be 
put in the form 

(6.4) dH» = (fcjd^ + <^dc 2 + aH*/8t dt 1§ 



_ Can d nota deri va tive^ 

the prime (') indicating that U = U' , /v There is a similar 
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expression for dH" At dt^« At the corner the two value* 
of H must be equal after the change in c^,c 2 , and t^. 
Hence we get an equation which has the form 

(6.5) <b|dc^ + <!>£dc 2 + H^ti = + d)Jdc 2 + f^dtj . 

Hence, If we may assume, in light of (6.3) that 

(eHVetK > (dH*7at) f , 

Z 1 Z 1 



we can solve ( 6 . 5 ) for d^ in terms of dc 1# do 2 . This 
furnishes the value to put into the equations for 6x(TT, 
6y(T). In equation (5*6) there is adjoined a term 



-[p 1 -fL 



U=U" 



U=tf * 



dt. 




for the corner and dt^ is expressed in terms of do^,dc 2 . 

When these terms are added to each equation in (5«7)» they 
are unchanged in form. 

This shows then how the routine is amended to handle 
corners . 

We have not considered the way in which the likelihood 
of detection may vary with the heading angle. For any. par- 
ticular listening device, it may be a function of heading 
angle and if the signal strength varies greatly as the sub- 
marine turns, there may be corners as a consequence of this. 
These should be easy to check for, since the signal is probably 
symmetric with respect to the centerplane of the submarine. 
Fortunately, if a corner is missed by a small amount, the 
probability of detection is not Increased much, since H and f 
must have the same value on both sides of the corner. 
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7 • Comments * 

✓ 

The problem discussed so far Is typical and Indicates 
the principal points. My colleague Professor W. E. Blelck 
has made up Fortran programs for some of the simpler problems 
and has run them, without any particular difficulties arising. 

Ppoblems wherein the total time is free (that is, not 
specified) , and wherein the final point is not given but only 
required to lie in a given region, are more tedious to program 
but are not essentially more difficult. The conditions on the 
route are not affected by the endcontltlons except as the con- 
stants of integration in the adjoint system are changed. 

It was initially hoped that a very general routine could 
be made up, one which would Include all likely difficulties, 
with a subroutine adjoined to resolve each of them. It is not 
clear now whether this is feasible. 

The principal difficulty lies in the nature of f and the 
way that it is generated and fitted. In the first place f 
will generally involve terms which are got from paWjd&ta, a 
collection of measurements. An examination of relevant data 
from Fleet Numerical Weather Facility suggests that there may be 
some problem in making up functions which have the required 
continuous derivatives with respect to the control variables. 
This part of the problem needs Investigation. Probably most of 
the actual work of getting the routine to run and to yield 
good routes is in the subproblera of collecting the data and 
fitting it, so that the necessary accuracy is attained without 
excessive computational time. 

If the data is too rough and irregular, it may be 
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necessary to go to steepest ascent methods and hopfc that there 
will be no corners. After the route Is determined, we may 
check the corner condition, but this Is time consuming. And 
if corners then need occur, the steepest ascent routine has 
an element of hit and miss In locating them. 

A general treatment of corners is out of the question in 
programming, but that is not really needed here. The function 
f represents physical phenomena, and hence It will have some 
mathematical structure. If it is likely to have several rela- 
tive minima, the people who work in the corresponding field 
will surely know this, and they must coordinate their work with 
the programmer so that he will know about when and where to look 
for these, and can organize the search program for them. This 
problem is not simple. 

It seems necessary also that the programmers of these 
problems have some understanding 6f the theory; none of these 
problems turn out to be routine. 

The optimum path generally has a nice property: If the 

submarine deviates from it by "small" amounts, the resulting 
route is "almost as good", since the route gives a stationary 
value to the probability and the first-order effects of changes 
are zero. 

So far as the writer knows, there is no general treatment 
in the literature of the numerical solution of problems where 
the control lies on the boundary of the region of allowability, 
though some problems of this type have been solved by the writer 
and others. It was necessary in discussing solutions to examine 
this problem in detail and to examine the idea of normality and 
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attainability. Essentially these are questions oOnoernlng the 
conditions under which a point can be attained, and under which 
all neighboring endpoints can be attained, and of uniqueness. 

To answer these, it is necessary to study the rank of certain 
functional matrices, matrices whose elements are integrals 
(functionals) with arguments obtained from the route. It was 
planned to include this as an appendix to this report, but the 
theory is not yet complete and seems to merit a separate report, 
which is in preparation. 

i 

There are many interesting ramifications of this problem. 
For example, if we know the location of the listening devices 
accurately, and the water conditions exactly, then there are 
sometimes blind, or deaf, areas, regions wherein the submarine 
has very low likelihood of being detected, though in neighboring 
areas the likelihood is large, f being virtually discontinuous. 
The theory of solution of these problems is not understood. 
Similar problems arise when air defense has weapons or radar, 
say, with sharply defined limits. 

The route may be changed as subsequent data is obtained. 
Indeed we may envision any route when followed by the submarine 
as a sequence of routes, with continual updating as subsequent 
data becomes available. If the data changes slowly, one or 
two iterations of the numerical routine will generate the neces- 
sary changes in the course. 

The procedures given here can be readily extended to a 
problem such as that of sending a submarine to launch a missile, 
if data on the payoffs and risks is available. The payoff 
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balances the likelihood of damage or destruction to the target 
against the corresponding quantities for the submarine.. The 
principal difficulty, in the writer's opinion, is the collection 
and fitting of data to describe the situation accurately. 

For those Interested in the earlier work on ship routing, 
it is summarized up fairly completely in the paper in Navigation 

[l] (the number in brackets refers to references listed at the 
end. The author and his colleagues have made a considerable 
comparison of the different methods; this is summarized in [2]. 
Some Fortran programs are available from Prof. W. E. Bleick. [ 3 ]. 
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